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Abstract 

We consider a (small) quantum mechanical system which is operated by an 
external agent, who changes the Hamiltonian of the system according to a fixed 
scenario. In particular we assume that the agent (who may be called a demon) 
performs measurement followed by feedback, i.e., it makes a measurement of the 
system and changes the protocol according to the outcome. We extend to this 
setting the generalized Jarzynski relations, recently derived by Sagawa and Ueda 
for classical systems with feedback. One of the two relations by Sagawa and Ueda 
is derived here in error-free quantum processes, while the other is derived only 
when the measurement process involves classical errors. The first relation leads 
to a second law which takes into account the efficiency of the feedback. 

1 Introduction 

Recent progress in statistical physics has led to nontrivial exact relations such as the 
fluctuation theorem [H 121 [3] and the Jarzynski relation [H [3], which hold even when 
physical systems are driven out of equilibrium. These relations reveal rich structures 
hidden in the canonical formalism of equilibrium states, and also suggest that there can 
be some universal structures out of equilibrium. Since these exact relations mainly deal 
with fluctuation, they are expected to find useful applications in small systems, where 
relevant energy scale is comparable to that of thermal fluctuation. 

In recent papers [HIE], Sagawa and Ueda studied the effect of feedback or the Maxwell 
demon in (small) thermodynamic systems. They showed that the second law of ther- 
modynamics and the Jarzynski relation should be properly modified in order to take 
into account the information of the system gained by the demon. In a recent beautiful 
experiment, Toyabe, Sagawa, Ueda, Muneyuki, and Sano [7J have designed a system 
with an artificial demon intervening the time evolution, and clearly demonstrated that 
one can convert information into useful work^l. They also confirmed the validity of one 
of the generalized Jarzynski relations obtained by Sagawa and Ueda |i6j, which we shall 
call Jarzynski-Sagawa-Ueda relations. 

In the present paper, we treat a quantum system with feedback, and look for ex- 
tensions of the Jarzynski-Sagawa-Ueda relations, which were proved only for classical 
systems. There may be a possibility that such extensions will become relevant to exper- 
iments or manipulations of small quantum systems. But let us stress that by studying 
quantum extensions one will get a better understanding of basic structures of the re- 
lations, e.g., which relation is universal and which is intrinsic to classical systems. We 
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believe that such an attempt is of interest from a purely theoretical point of view. In 
fact we found that one of the two relations derived by Sagawa and Ueda can be derived 
in an error-free quantum process, while the other can be (for the moment) shown only 
when we include somewhat artificial classical errors into the process. For other related 
works on processes including feedback and/or measurement, see [H |9] and references 
therein. 

The present paper is organized as follows. In section [21 we study the most basic 
setting with no errors and derive the quantum extension of one of the two relations by 
Sagawa and Ueda. In section [31 we introduce classical errors to the feedback process, 
and derive a quantum counterpart of the other relation. In section [H we discuss some 
variations and extensions of the main results as well as a related interesting issue of 
"clockwork demon." 



2 Error-free feedback 

Let us start from an ideal setting with no errors, and present our main result. 

Setting We consider an isolated quantum mechanical syste whose Hamiltonian has 
parameters which can be controlled by an outside agent. The system is initially pre- 
pared in the equilibrium state. In the first stage of the time-evolution, the Hamiltonian 
is changed according to a fixed protocol. Then one makes a measurement on the system. 
The second stage of the time evolution takes into account feedback from the measure- 
ment, and the Hamiltonian is changed according to a protocol which depends on the 
outcome of the measurement. 

Let us be more precise. By H^'^^ we denote the initial Hamiltonian of the system. Its 
normalized eigenstates and the corresponding eigenvalues are denoted as yjj and 
respectively, with i = 1,2,.... The projection onto (fi is denoted as We write the 
corresponding canonical density matrix a^ 

^0 ^0 

with Zq := e~^^i \ Finally F'-^^ := — log Zq is the corresponding free energy. 

Since we perform feedback, the Hamiltonian H^^^ at the final moment depends on 
the outcome j = l,...,n of the intermediate measurement. We denote by i/j^^^ and 
E^^^ the normalized eigenstate and the corresponding eigenvalue, respectively, of H^^^ 
with k = 1,2,.... The projection onto ip^^^ is denoted as PjfK Again we write the 



The system can be a small (and literally isolated) one, or a combination of a (small) system of 
interest and a larger system which plays the role of the heat bath. 
By A := B OT B =: A, we mean that A is defined in terms of B. 
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corresponding canonical density matrix as 



^ k ^ 

with Zj := ^fce~'^^fe^\ and the free energy as F^-^^ := —/3~^\og Zj. 

We consider the following process in the line of (TU] (see also [H]). Initially the 
system is in the equilibrium state piaL At the initial moment, one makes a projective 
measurement of the energy whose outcome is denoted as Ei or simpljo i- Then 

the Hamiltonian is changed according to a fixed protocol for a certain amount of time, 
and the state of the system evolves by an unitary operator U. This is the first stage. 
Then one makes a projective measurement^ with outcomes j = 1, . . . ,n. We assume 
that the measurement is described by a set of projection operators IIi, . . . , n„ such that 
Yl^=i = 1 and Hjllj/ = if j 7^ j'. The rest of the time evolution, which is the 
second stage, depends on the outcome j. The Hamiltonian is changed according to a 
fixed protocol associated with j, and the state evolves by an unitary operator Uj. Finally 
one makes a projective measurement of the final Hamiltonian H^^\ whose outcome is 
denoted as E^^^ or k. 

The probability that one gets successive outcomes i, j, k in the above process is 
given by 



Pit ^j-^k) := Tr[p(^) U, H, f/Pf f/t H, f/j P^^^ ] (2.3) 

Zo 

One can easily verify that it is normalized as YlijkPi''' j ^ k) = 1. We define the 
average with respect to p{i j ^ k) as 

(/(z,j,A;))p ■.= J2f{^,J,k)pi^^J ^ k), (2.4) 

where f{i,j, k) is an arbitrary function of i, j, and k. 
Main result In this setting we show that 

exp[/3{W^,,,,-(p(°)-p(^))}l) =7, (2.5) 

where Wij^k ■= Ef - E^^\ and 

7:=$^Tr[H,t/jp(£f/,H,]. (2.6) 



^ For simplicity we assume that i?*^*^) has no degeneracy so that an accurate measurement of the 
energy uniquely determines i. But this assumption is not essential. 

^ It is trivial to extend the results to the case where one makes measurement and feedback repeatedly 
as in [5]. 
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This is the quantum extension of one of the generahzed Jarzynski relations derived by 
Sagawa and Ueda [6j. The equahty fl2.5p corresponds to equation (6) in [6j. 

Since Wij^k is the difference between the initial and the final energy of the system, 
it is natural to identify it with the work done by the system. But let us remark that 
this definition relies on the rather artificial setting where one precisely measures the 
energy in the initial and the final moments (but see the beginning of section HJ where we 
discuss the corresponding inequality). We also note that, in quantum systems, exchange 
of work also takes place during measurement processes. 

The quantity Tr[nj f/| piin Uj Uj ] which appears in (12. 6 p can be interpreted as the 
probability that one observes Uj when the system starts from the equilibrium state 
Pcan = e~^^^^^ /Zj and evolves by the inverse time-evolution f/j. This probability is 
expected to be close to one if the time-evolution Uj is chosen in such a way that any 
state within the range of lij evolves into a state not too far from the equilibrium state 
Pcan. In such a case, 7 becomes much larger than unity, suggesting that the feedback is 
designed in an efficient manner. Note that 7 can be less than unity for a badly designed 
feedback. See the example below. As is stressed by Sagawa and Ueda [6j, a remarkable 
feature of the quantity 7 is that it can be measured by independent experiments. 

Derivation By noting that P^^^ = 1, and using the property of the trace, one gets 



$:Tr[Pi^')f/,n,f/tp(^-)]^ 



(j) 



= 5^Tr[n,t/]pi^)f/,n,]^— . (2.7) 

i,k ^ 

By recalling ( 12. 2p . we see that the right-hand side is equal to 7 of (12. 6p . By noting that 
Zo/Zj = exp[-/3(F(°) - F(J))], we get the desired relation ( 1231) . 

Example As a simple illustrative example, consider a two-level system. We set t/ = 1 
and Uj = Pj^\ i.e., the intermediate measurement is the same as the initial measurement 
of the energy. As for the feedback, we set f/i = 1 and let U2 be the operator which simply 
switches the two eigenstates of H^^\ We also set H^^^ = H^'^^ = H^^\ Then we have 
p(l ^ 1 ^ 1) = e-^<V^o and p(2 ^ 2 ^ 1) = e-^""-"^ /Zq with Zq = e"^<' + e'^^^''^ 
and p{i — )■ j — )■ fc) = for all other combinations. We then find 

^ ,„, . (2.8) 

When E^^ < Ef\ the right-hand side, which is 7, is clearly larger than unity. This 
reflects the fact that the demon has made a clever use of the information to get extra 
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work from the system. The case Ef'^ > E^^ , where 7 become less than unity, provides 
an example of a failed demon who made a wrong use of the information to lose work. 

3 Feedback with classical errors 

Next we consider a feedback process which includes errors, and extend the other relation 
obtained by Sagawa and Ueda. 

Setting We consider almost the same process as in section [2], but assume that the 
intermediate measurement now involves errors. We assume that the errors are of purely 
classical natur^, i.e., when the intermediate measurement (described by ni,...,n„) 
yields the result j, one mis- interprets the result as j' with a given probabilit}|§ e(j — )■ 
j') > 0. The probability is normalized as e(j — > j') = 1 for any j. The error-free 
process considered in section [2] is recovered by setting e(j — j- j') = 5jji. In what follows 
we assume that for each j', the probability e(j — )■ j') is either vanishing for all j or 
nonvanishing for all j. 

The rest of the process (i.e., the second stage of the time evolution and the final 
measurement) is executed according to the result j' (not j). This means that the 
probability (12.31) is modified as 

p{i ^ J ^ j' ^ k) := Tr[Pi^') f/,, f/Pf ^ f/t n, U], Pj:''^ ] e{j ^ f) (3.1) 



^0 



As in (12. 4p . we denote the average over this probability as 

(/(^,J,/,A:))p:= /(^,J,/,fc)p(^^J^/^A;). (3.2) 

Let us also define 

V2{3)-=Yv{^^ 3 ^ 3' ^k), n{3')-=Yv{^^ 3 ^ 3' ^k), (3.3) 

i,j',k 

and 

P2,3 (j,j') := 5^P(^ ^ J ^ / ^ k), (3.4) 

i.k 

which are the probabilities to observe j, to observe j', and to observe a pair 
respectively. As in [6], we define the (unaverage) mutual information as 

/,■,/:= log — , , , — = log-— 4 3.5 

P3(j') ^P2(j)P3(j') ^ ^ 



^ We admit that this setting is artificial. The main motivation for studying it is that we can derive 
the second Jarzynski-Sagawa-Ueda relation p.7p only in this setting. 
^ In the notation of [6], e(j j') should read 
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where the second equahty comes from P2,3{j,j') = P2(j)e(j j')- By averaging this, 
one gets 

&'). = Ep..a./)log|i^. (3.6) 
which is the mutual information. 



Main results In this setting we show that 

(exp [(3{W,,,,k - {F^^^ - F^^'^)} - /,,,,] )^ = 1, (3.7) 

where the "work" is defined by Wij'^k '■= Ff'^ —E^^ ■* as before. This is a quantum version 
of the other generalized Jarzynski relation, equation (4) in [6] , derived by Sagawa and 
Ueda. Interestingly, this type of equahty seems to be derivable only in the present 
setting with classical errors. Indeed the mutual information (13. 5p . (13. 6p is a purely 
classical quantity as opposed to the QC- mutual information (see [5]), which takes into 
account the full quantum nature of the systen|^. See the discussion about the error- 
free limit at the end of the present section, and about the corresponding inequality in 
section HI 

In the present setting with errors, we can also derive a relation which is exactly the 
same as (12.51) but 7 replaced by 

7 := E <3 ^ ^■') n, U], p({) f/,, ]. (3.8) 
3d' 

Derivation As in (12. 7p . we use ^^Pf^ = 1 and Yij = 1 to observe that 



(0) 



7 A/\ / - ^^l^ k ^ 3^^3 ^ ^ I ^ ^^3 ^ ]' ^ k J 7 



= j:^APPu,u,uj,ppr-^Mf) 

3,3',k ^ 

= ETr[^i' ] -^^'^^'^ = E^3(/) = 1, (3.9) 

j',k j' 

where we noted Tr [ Pjf ^ ] = 1 . By recalling the definition (13. 5p , we get (13. 7p . 

The derivation of (12. 5 p with 7 replaced by (13. 8p is essentially the same as that in 
section [21 and is omitted. 



^ We note, however, that our equahty p.7p is vahd as it is when we take into account quantum 
mechanical errors by measurement operators Mj which satisfy a certain condition. Sec section |4l 
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Error-free limit Consider the limit where e{j — )■ j') tends to 6jj>, where one recovers 
the error-free setting of section |2J The (unaverage) mutual information fl3.5p becomes 
Ijj' — Sjj' Sj with Sj = — logp2(j) = — logpaO). Thus the averaged quantity (I3.6p 
becomes {Ij,j')p {Sj)p = — Xlj PaO) logp2(j), which is the Shannon entropy. 

Then one might be tempted to conjecture the validity of a relation corresponding to 
(13. 7p for the error-free setting of section |2l namely, 



{exp 



/3{W,j,, - (fW - - Sj\ ) = 1. (3.10) 



Unfortunately, a careful look at the above derivation reveals that this is not valid in 
genera B In dSlD, we are making use of the relation e{j — >■ j')/e{j — )■ j') = 1, which is 
not true in the error-free limit. In fact one can easily check that the conjectured (I3.10p 
does not hold in the two-level system considered at the end of section [2j 



4 Further observations and discussions 

Corresponding inequalities As is always the case, one can use Jensen's inequality 
(e-^) > e^-^^ to derive inequalities from the equalities that we have shown. From (12. 5p . in 
particular, we get 

{W.,,k)p < F^'^ - J2p2U) F^'^ + -n log7, (4.1) 

3 ' 

where P2{j) '■= J2ikPi''' ~^ j ^ k) = Tr[nj U p'^Jn U'^ ] is the probability that one gets 
an outcome j in the intermediate measurement. Note that the left-hand side is written 
as 



where 



^fin ^ (0) ^.i^ n ^ ) 



TT[UjUp)^JnW n 



is the final state of the system when the outcome of the intermediate measurement is j. 
It should be remarked that (14.20 only involves standard quantum mechanical expectation 
values in the initial and the final states. This is in contrast with the left-hand side of 
the equality (12. 5p . which is defined only in a rather artificial setting where one measures 
the energy both in the initial and the final moments. Since (14. 2 p is the expectation 
value of the total work done by the system!"], the inequality (14. ip can be interpreted 
as a generalization of the second law of thermodynamics. This is distinct from the 
second law derived by Sagawa and Ueda in [5] , which is valid for quantum systems with 
feedback. 



It is a tacit assumption in [5] that P[?/|r„] is always nonvanishing. Although the example of the 
Szilard engine considered in [B] fails to satisfy the assumption, the relation (4) happens to be valid for 
certain reasons specific to the model. We thank Takahiro Sagawa for clarifying this point. 

As we have noted before this includes work exchanged during the measurement. 
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Obliviously one can replace e^^^^^ ^-^k^) in the left-hand side of (12. 7p by e^^^ ^~^fc-^fc^' 
with an arbitrary to get an exact relation. This relation again yields an 

inequality for Tr[i7*^°)pian] and Tt[H'-^'' p^^], which is more general than (14. ip . It would 
be interesting to see whether one can get stronger inequalities than (14. ip by choosing 
optimal Pj which reflect the nature of the operation and the feedback. 

From the equality (13. 7p . one gets another second law 

{W,,f,kh < F^''> - E^3(/) F^''^ + ^{hf)p^ (4.4) 

where 

(W^,,, = Tr[if(°)pW ] - Y.P^Mf) ^^'-''^Pt'^] (4.5) 

i.i' 

is again the expectation value of the total work, where we wrote 



The inequality (14. 4 p looks identical to the second law for quantum systems with feed- 
back derived by Sagawa and Ueda [5], but their inequality contains the QC- mutual 
information rather than the classical mutual information {Ijj')p- The two inequalities 
are indeed different relation^. We also note that one can safely take the error-free limit 
in the inequality fl4.4p since nothing like 0/0 is encountered here. 

General measurements Let us remark that the same derivation as in section [2] 
works if one replaces the projections Hi, . . . , n„ with general measurement operators 
Ml, . . . , Mn which satisfy J2j M^Mj = 1. One gets the Jarzynski-Sagawa-Ueda relation 
(12. 5 p and the corresponding inequality (14. ip with 7 replaced by 
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5^Tr[Mjf/jp^),f/,M,]. (4.7) 



Note that the summand is not the probability of observing Mj in the state Uj pi&n Uj 
unless Mj is Hermitian, since in (14. 7p we have iWj instead of Mj. It is expected that 
Mj corresponds to a suitable "time-reversed" measurement. See, for example, [13]. 

The relation (13. 7p . on the other hand, can be derived (as it is) only when one has 
"^jMjMj = 1. This condition is valid when all Mj are Hermitian, or (more generally) 

when [Mj, Mj] = for all j, but is not valid in general. 



If one applies the result of [5 to our setting, one gets an inequality which takes into account 
"quantum mechanical errors" but is independent of the classical error probability e{j j') [12]. On 
the other hand our inequality (which, as we explain below, is valid as it is if the measurement is 
described by operators Mj which satisfy a certain condition) is apparently insensitive to quantum 
mechanical errors. 
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Quantum Jarzynski relation with measurement Consider the error-free setting 
of section [21 and further suppose that the agent makes a measurement, but do not 
perform any feedback. This means that we take Uj = U', H^^^ = H', and pcan = Pcan 
any outcome j = 1, . . . , n. 

In this case we see from (12 .Op that 

7 = 5^ Tr [ n, {Wy p;,, U' n, ] = Tr [ (U')^ p^,, U' ] = Tr [ p^,, ] = 1, (4.8) 
j 

and hence our main result (12. 5p reduces to the quantum version of Jarzynski relation 
[To] . Since a measurement process generally disturbs a quantum state, it is a nontrivial 
fact that the quantum Jarzynski relation gets no modifications here. This is closely 
related to the extension of fluctuation theorem in [8]. 

When projective measurement is replaced by more general measurement as above, 
we have 7 = 1 only when the condition MjMj = 1 is valid. 

If one takes the setting of section E] with errors, and assumes that e(j — > j') is 
independent of j, one immediately gets 7 = 1 from (13. 8p . Thus we also have the 
standard Jarzynski relation in this case. This is natural since one has Psij') = e(j — )■ j') 
and hence Ijj> = 0, i.e., the agent is making no use of information. 



On "clockwork demon" We have here assumed the existence of an external intel- 
ligent agent (demon) who performs feedback taking into account the outcome of the 
intermediate measurement. It is also interesting to consider the possibility of designing 
an external quantum mechanical system, a "clockwork demon", which is programmed 
to perform the exact feedback we wanto. 

The Hamiltonian of the whole system is written as Htotit) = -ffsystcm(i) + -f^demon(^) + 
Hint{t), and its time-dependence is fixed in advance. The interaction Hamiltonian ifint(t) 
is vanishing in the initial and the final moments. Initially both the system and the 
demon are in their (canonical) equilibrium stated with a common (3. Then the demon 
Hamiltonian i?demon(^) and the interaction Hamiltonian Hi^t{t) are changed to let the 
demon interact with the system as designed. The actual design of such an autonomous 
feedback system is far from trivial. It is indeed a nontrivial question whether one can 
realize an arbitrary feedback scenario in this manner, but we won't go into details here. 

It is crucial that the original Jarzynski relation without feedback |H [10] applies to 
this situation. Since the system and the demon are decoupled in the initial and the final 
moments, the relation reads 

exp 



P{W - (i^SU - i^Stem)} ) = exp[/3(F-l, - F!:^J], (4.9) 



The following discussion of course applies to the classical setting (as in [6]) as well. We also stress 
that this is quite a standard thought, which has appeared in many different contexts. 

In many cases, it is more natural to assume that the demon is initially in a quasi-equilibrium state. 
More precisely, one assumes that the state of demon is initially restricted to a certain subspace of the 
whole Hilbert space, and distributed according to the canonical distribution within the subspace. Then 
the original Jarzynski relation does not apply, and the following discussion is not valid as it is. 
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where W is the difference between the initial total energy and the final total energy. We 
here make a nontrivial and crucial assumption that the clockwork demon is designed 
in such a way that it does not exch ang e appreciable work with the system or with the 
agent who changes the Hamiltoniad^H Then the work W is interpreted as essentially 
the work done by the system to the external agent, and the left-hand side of (14. 9 p can 
be identified with that of (12. 5p . Comparing (14. 9 p with (12. 5p . one sees that 7, in this 
case, is directly related to the free energy difference of the clockwork demon. 

Let us stress, however, that this consideration does not diminish the significance of 
Sagawa and Ueda's generalization nor reduce it to the original Jarzynski relation. The 
power of the generalized relation appears, for example, in the compact representation 
(12.61) of 7, which does not only suggest a clear interpretation but also makes it possible 
to measure 7 experimentally. One can say that, by considering an idealized setting 
with feedback, Sagawa and Ueda were able to sort, in quite a neat manner, complicated 
exchange of heat and work into the part which is directly related to the feedback and 
the part intrinsic to the system. 

We wish to thank Takahiro Sagawa for indispensable discussions and comments, Jordan 
Horowitz and Akira Shimizu for useful discussions. 
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